Character Education 


WWC EVIDENCE REVIEW PROTOCOL FOR 
CHARACTER EDUCATION INTERVENTIONS 


Topic Area Focus 

Character education is an inclusive concept regarding all aspeets of how families, sehools, and 
related soeial institutions support the positive eharaeter development of ehildren and adults. 
Character in this eontext refers to the moral and ethieal qualities of persons as well as the 
demonstration of those qualities in their emotional responses, reasoning, and behavior. Charaeter 
is assoeiated with sueh virtues as respeet, responsibility, trustworthiness, fairness, earing, and 
eitizenship. Charaeter edueation programs are aetivities and experienees organized by a provider 
for the purpose of fostering positive eharaeter development and the associated eore ethieal values 
(also deseribed as moral values, virtues, eharaeter traits, or prineiples). 

The What Works Clearinghouse (WWC) review of this topie focuses on eharaeter edueation 
programs designed for use in elementary, middle, or high sehools with attention to student 
outcomes related to positive eharaeter development, prosocial behavior, and academie 
performanee. Closely related program areas, sueh as soeial-emotional learning, eonfliet 
resolution, violenee prevention, soeial skills training, serviee learning, and the like, may be 
addressed in future WWC reviews but are not intended to be eovered by this one. 

A systematie review of evidenee in this topie area addresses the following questions: 

• Whieh eharaeter edueation programs have proven effeetive for improving student 
outeomes related to positive eharaeter development, prosoeial behavior, and aeademie 
performanee? 

• Are different eharaeter edueation programs effeetive for improving different outeomes, 
partieularly aeademie performanee? 

Key Definitions 

Character education. Broadly, eharaeter education encompasses all aspeets of the influenee that 
families, sehools, and other soeial institutions have on the positive eharaeter development of 
ehildren and adults. 

School-based character education programs. These are programs implemented in elementary, 
middle, or high sehools that involve deliberate, proactive attempts to foster positive eharaeter 
development. Charaeter edueation programs are distinguished by a predominant emphasis in 
their program materials and implementation on instilling, teaehing, or promoting a range of eore 
values (deseribed also as ethieal values, moral values, virtues, eharaeter traits, or prineiples). 
Charaeter edueation programs have features that overlap with those of sueh other program areas 
as soeial-emotional development, eonfliet resolution, violenee prevention, soeial skills training, 
and serviee learning but are differentiated from them by having both the following 
eharaeteristios: 
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• Character education programs are primarily designed to promote values that may be 
generalized across contexts rather than focused on a single domain (e.g., conflict 
resolution, drug use, unsafe sexual behavior). 

• Character education programs dedicate most or all of their lesson units or prescribed 
activities and events to teaching core values directly or indirectly (e.g., through role 
models, literary examples, etc.). 

Values. The value domains on which character education programs generally focus are the 
following; 

• Intrapersonal values — those characterizing the individual’s behavior and attitudes in a 
wide range of situations and activities (e.g., honesty, courage, perseverance, self- 
discipline, responsibility, integrity). 

• Interpersonal values — those characterizing the individual’s behavior and attitudes toward 
others, especially as expressed in relation to family, peers, teachers, and persons in the 
student’s immediate social environment (e.g., caring, respect, empathy, trustworthiness, 
fairness, tolerance of diversity). 

• Civic virtues — those characterizing the individual’s behavior and attitudes toward the 
community and society (e.g., good citizenship, patriotism, justice). 

Comprehensive and “modular” character education programs. School-based character 
education programs can be divided into two broad categories differing in the nature and scope of 
their implementation as follows: 

• Comprehensive programs are those aimed at affecting the school as a community by 
integrating character education into the full spectrum of school activities and school life 
through such means as (a) involvement across curricular topics, discipline practices, 
after-school activities, and other such school functions; (b) participation by teachers, 
principals, school staff, parents, and especially students in program design and 
implementation; and (c) multiple approaches to teaching character (e.g., instruction, 
modeling, special events, community service, experiential learning). 

• Modular programs are those designed to be used in a single classroom or group of 
classrooms (e.g., a set of character education lessons) or involve a particular type of event 
or activity, such as an inspirational speaker. Modular programs can be schoolwide 
without necessarily being comprehensive (e.g., lessons taught to all students in at least 
one class, such as social studies, or with all students exposed to one or more special 
events). 

Character development and behavioral outcomes. Within the field of character education, core 
values are typically understood as having cognitive, emotional, and behavioral dimensions. That 
is, students are expected to understand what the values mean (e.g., be able to reason about them), 
care about them (e.g., internalize them as enduring dispositions), and enact them in their 
behavior. Examples of relevant outcomes include: 
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• Understanding values. Students’ ability to recognize values and how they may affect 
people and actions in different situations, their understanding of ethical dilemmas, and 
their ability to make critical judgments about their own and other people’s behavior in 
different situations. This category encompasses all outcome variables that center on 
knowledge or reasoning about any relevant aspect of character or the values and behavior 
associated with it. 

• Caring about values. The perceived importance of core values and students’ opinions 
about how they should behave in different situations. This category encompasses all 
outcome variables that center on attitudes, feelings, self-perceptions, character or 
personality traits, and the like that are related to character or the values and behaviors 
associated with it. 

• Enacting values. Behavior that displays core values (e.g., participation in community 
service), prosocial behavior (e.g., supporting peers), or decreased problem behavior (e.g., 
substance use, fighting, disciplinary referrals). This category encompasses all outcome 
variables that center on the actual enacted behavior of students that relates to character or 
the values associated with it. 

Academic outcomes. Measures of academic achievement, such as grades or test scores, and 
measures of academic persistence or participation, such as attendance, retention, or graduation. 

General Inclusion Criteria 


Populations to be Included 

The population of interest includes K-12 general and/or special education students attending 
elementary, middle, or high school at any type of school (public, private, parochial, etc.). The 
students must attend a school in the U.S. or its territories or tribal entities, or in an English- 
speaking country with a sufficiently similar cultural context that the study can be realistically 
replicated in the U.S. 

Types of Interventions to be Included 

The interventions considered for inclusion are identified through an exhaustive search of the 
published and unpublished literature as well as a review of nominations submitted to the WWC. 
For an intervention to be included in the review, the main goal and focus in its lessons, activities, 
and/or organization must be the direct or indirect teaching of a range of core values. The 
intervention does not necessarily have to be referred to as a character education program if it 
otherwise meets this criterion. Only interventions that are replicable (i.e., documented well 
enough that they can be distinctly identified and reproduced) will be included. Finally, all 
interventions should be delivered during the regular school day and school year; after-school and 
summer programs will not be included. 
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Within the above eonstraints, three broad types of interventions are eligible for inelusion; 

1 . Programs. Examples of sehool-based eharaeter edueation programs inelude: 

• A eurrieulum to promote eharaeter values among high sehool students that 
integrates eharaeter edueation aetivities into several aeademie subjeet areas 
ineluding soeial studies, English, and math. 

• An elementary sehool program in whieh the entire sehool beeomes a eommunity in 
whieh all partieipants — ehildren and adults alike — work together to foster values of 
oaring, helping, respeot, and toleranoe. The approaoh involves training the adults in 
a ohild’s life to model, teaoh, and embody oore prinoiples. 

• A literature-based program to promote oore values. The program oonsists of in-olass 
lessons that inelude stories, puppets, finger plays, rhymes, songs, and aotivity books. 

2. Practices or strategies. Examples of eharaeter edueation praotioes inelude: 

• Prooesses in whieh sehool staff and eommunity members reaoh oonsensus about 
what a eharaeter edueation program should inelude and/or partioipate in the ongoing 
implementation of the program. 

• Teaohing strategies (e.g., oooperative learning fooused on promoting helping/oaring 
behaviors or aeeeptanee of diversity, elassroom diseiplinary system to enable 
student responsibility). 

• Professional development for sehool staff on eharaeter edueation topies or methods. 

• Proeedures for assessing and reeognizing relevant values and attributes (e.g., 
awards, reeognition eeremonies). 

3. Policies. Examples of eharaeter edueation polieies inelude: 

• Systemwide or sehoolwide behavior eodes and diseipline polieies that foeus on 
promoting oore values in eharaeter edueation. 

• Sehool polieies that require moral leadership from sehool administrators, staff and 
students. 

For this WWC review, eharaeter edueation products (e.g., workbooks, videos, and interaotive 
CD-ROMs) are not inoluded, exoept as they are inoorporated into a program, praotioe, or polioy 
as desoribed above. A large variety of produots are offered to elementary, middle, and high 
sohools for individual or group use. Serutiny of the full list is beyond the seope of this review. In 
addition, it is believed that little researeh exists on the outeomes produeed by the use of sueh 
produots. 
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Types of Research Studies to be Included 

The review foeuses on well-eondueted randomized and nonrandomized eontrolled trials of 
eharaeter edueation programs, praetiees, and polieies. To be eligible, studies must have been 
published in 1983 or later and report outeome measures taken on students, not solely teaehers, 
parents, or other partieipants in the program or sehool. At least one of the outeome measures 
must foeus on eharaeter edueation outeomes or aeademie performanee and demonstrate adequate 
reliability or faee validity. 


Specific Topic Parameters 


The following parameters speeify whieh studies will be eoded for the review and the aspeets of 
those studies that are eritieal to how they are eoded. 

1. Commonly shared and/or theoretically derived characteristics of the intervention that 
should be reflected in its definition and implementation. 

• The primary emphasis of the intervention is on instilling, teaehing, or promoting 
eore values that ean be generalized aeross eontexts (that is, are not foeused on a 
single domain sueh as eonfliet resolution, drug use, or unsafe sexual behavior). 
Values of this sort inelude, for example, honesty, eourage, perseveranee, self- 
diseipline, responsibility, integrity, earing, respeet, trustworthiness, fairness, 
eitizenship, patriotism, justiee, and the like (deseribed also as moral values, virtues, 
eharaeter traits, or prineiples). Qualifying interventions will have most or all of their 
lesson units, preseribed aetivities or events, and/or training and program materials 
dedieated to this objeetive in readily apparent ways. 

• Attention is given to a range of values of the sort identified above; that is, multiple 
values ean be identified in lesson plans, preseribed aetivities, ete. in eontrast to a 
foeus on a single value or a set of very elosely related values (sueh as those having 
to do only with peer relationships or only with eommunity serviee aetivities). 

• The intervention is a program, praetiee, or poliey but not exelusively a produet (e.g., 
workbook, video, interaetive CD-ROM), and it is replieable. Replieability will be 
assumed for branded programs that have a name and are marketed to sehools, and 
for distinetly identifiable programs, praetiees, or polieies (i.e., those that appear 
under the same name in different plaees or are assoeiated with a partieular developer 
or disseminator) that are doeumented well enough to be implemented by a provider 
other than the developer. 

• The intervention is implemented in an elementary, middle, or high sehool during the 
regular sehool day and aeademie year; after-sehool and summer programs will not 
be ineluded. 
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• In addition, interventions will be eharaeterized for deseriptive purposes as 
eomprehensive, modular, or (if neeessary) something in between, with all these 
variants eligible for inelusion. 

2. Important characteristics of the intervention that must be known in order to reliably 
replicate it with different participants, in other settings, at other times. An intervention 
is considered to be replicable if: 

• The intervention is “branded.” 

• The intervention is not “branded” but meets the following eonditions: 

— The intervention is deseribed in general terms. 

— The duration of the intervention is deseribed. 

— The eharaeteristies of the individuals who are expeeted to deliver the intervention 
are deseribed. 

3. Important classes of outcomes, 

• Character development as reflected in understanding, caring about, and/or enacting 
core ethical values (knowledge, attitudes/values, or behavior) 

• Prosocial behavior or reduction of problem behaviors that represent a behavioral 
expression of core values 

• Academic performance 

4. Evidence sufficient for an outcome measure to demonstrate each type of reliability 
(internal consistency, temporal stability/test-retest, and inter-rater). 

Standard WWC values will be applied to these reliability considerations as follows: 

• Internal consistency: .60 

• Temporal stability/test-retest: .40 

• Inter-rater reliability: .50 

5. Interval of time within which studies should have been conducted to be appropriate for 
the Evidence Report, 

Studies must have been conducted within the past 20 years (i.e., with a publication date of 
1983 or later). This is the default time interval for all WWC reviews. Timing will be judged 
by the date of earliest publication of any report on the study outcomes. The publication date 
for unpublished studies will be the date the document reached its final form. 
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6. Necessary characteristics that define the target population. 

Students are between the ages of 5 and 21 and are enrolled in grades K through 12. Students 
attend an institution within the United States (ineluding U.S. territories and tribal entities) or 
within an English-speaking eultural setting for whieh the study eould realistieally be 
replieated in the U.S. In addition, interventions will be eharaeterized for deseriptive purposes 
with regard to the population with whieh they are implemented, ineluding speeial 
subpopulations of ehildren (e.g., ehildren with learning disabilities or language impairments, 
English language learners, ete.). 

7. Important characteristics of participants that might be related to the intervention’s 
effect that must be equated if a study does not employ random assignment. 

Studies that do not employ random assignment must demonstrate the initial equivalenee of 
the eomparison groups, or ensure it through statistieal eontrol, with regard to: 

• Pretest seores for at least one outeome measure 

• Grade level or age 

• Gender 

• Any speeial status sueh as speeial edueation, ELL, ete. 

• Loeation of the sehools involved (urban, suburban, or rural; geographieal region) 

8. Relevant subgroups of interest for this review, in addition to age or grade, gender, 
disability status, and race/ethnicity. 

• Seeond-language learners or ehildren with eultural baekgrounds different from the 
loeal dominant eulture 

• Children with a history of sehool diseiplinary infraetions or who are otherwise 
identified as at risk for anti-soeial behavior 

9. Relevant settings of interest for this review. 

• Sehools in urban, suburban, or rural loeations 

• Publie, private, and speeial-purpose sehools 

10. Appropriate interval for measuring the intervention’s effect relative to the end of the 
intervention. 

The benefits of a eharaeter edueation intervention are expeeted to appear by the end of the 
intervention and to be retained past that point. Thus measures at the end of an intervention 
and any time thereafter are appropriate. 
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11. Amount of differential attrition from the intervention and control groups assumed to be 
problematic. 

The WWC default value will be used: Differential attrition is defined as a differential loss of 
greater than 7%. If differential attrition is less than or equal to 7%, the assoeiated bias will be 
assumed minimal. If differential attrition is greater than 7%, the study must show that it did 
not bias the effeet size estimate by demonstrating post-attrition group equivalenee on the 
pretest for at least one major outeome variable. This may be aeeomplished by showing 
nonsignifieant differenees with an adequately powered (.80) statistieal signifieanee test or a 
standardized mean differenee between groups of d = .10 or less. 

12. Amount of overall attrition from the study sample assumed to be severe. 

The WWC default value will be used: Severe overall attrition is defined as a loss of more 
than 20% of the sample assigned to the relevant study eonditions. If overall attrition is less 
than or equal to 20%, the assoeiated bias is assumed to be minimal. If overall attrition is 
greater than 20%, the study must show that it did not bias the effeet size estimate by 
demonstrating post-attrition group equivalenee on the pretest for at least one major outeome 
variable. This may be aeeomplished by showing nonsignifieant differenees with an 
adequately powered (.80) statistieal signifieanee test or a standardized mean differenee 
between groups of d = .10 or less. 

Methodology 


Literature Search Strategies 

The WWC Evidenee Report Team employs eomprehensive and systematie literature seareh 
strategies to identify the population of published and unpublished relevant studies. This seetion 
eontains topie speeifie elements of the literature seareh (e.g., seareh terms, additional journals, 
and assoeiations). 

Key Word List 


Aeademie Aspiration 
Aeademie Goal 
Altruis* 

Anti-Semitism 
Attitude skills 
Bully* 

Caring 

Charaeter 

Charaeter Development 
Charaeter Edueation 
Charaeter Traits 
Citizenship 
Civie Engagement 


Civies 

Civility 

Classroom Climate 
Classroom Environment 
Collegiality 

Commun* Responsibility 

Community 

Community Serviee 

Compete 

Competit* 

Confliet 

Confliet Resolution 
Cooperation 


Courage 

Cultural 

Currieulum 

Deeision 

Deeision Making 

Delinquen* 

Demoera* 

Diseiplin* 

Disrupt* 

Diversity 

Emotion* 

Emotional Intelligenee 
Emotional Learning 
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Empath* 

Empower* 

Equality 

Ethical Development 

Ethics 

Expulsion 

Fairness 

Family Values 

Generosity 

Graduation 

Homophobia 

Honesty 

Impact 

Integrity 

Interpersonal 

Interpersonal Skills 

Involvement 

Justice 

Kindness 

Leadership 

Moral 

Moral Education 
Moral Reasoning 
Motivation 


Multicultural 

Nonviolence 

Patience 

Peaceful 

Peer 

Peer Pressure 
Perseverance 
Problem behavior 
Problem solving 
Pro-Social 
Racism 
Relationship 
Religion 

Religious Education 

Resilience 

Respect 

Responsib* 

Retention 

Safe* 

School Climate 
School Environment 
Self Esteem 
Self-Reflection 
Service 


Service Learning 
Sexism 

Social Development 

Social Justice 

Social Responsibility 

Social-Emotional 

Substance Abuse 

Suspension 

Theft 

Tolerance 

Trustworthiness 

Values 

Values Clarification 
Vandalism 
Violence 
Virtue 
Volunteer 
Whole Child 
Work Ethic 
Work Habit* 

Youth Activity 
Youth Program 


A combination of Boolean terms such as AND and OR will be used with this keyword list. The 
librarian at AIR will be consulted as to the appropriate combination to use and then tailor 
according to each specific electronic database. 

Supplementary List of Journals to be Hand Searched 

1 . Journal of Research in Character Education 

2. Journal of Adolescent Research 

3. Journal of Consulting and Clinical Psychology 

4. Journal of Research on Crime and Delinquency 

5. Journal of Quantitative Criminology 

6. Criminology 

7. Journal of Community Psychology 

8. Psychology in the Schools 

9. Criminal Justice and Behavior 


9 



Character Education Programs: Benefits for Character Development, Prosocial Behavior, 

and Academic Performance 


10. Justice Quarterly 

1 1 . Crime and Delinqueney 

12. Evaluation Review 

Additional journals will be added to the supplementary list when a few artieles appearing in them 

are identified through other seareh proeedures. 

Supplementary List of Organizations 

1 . Assoeiation for Supervision and Currieulum Development 

2. Tanglewood Researeh (http://www.tanglewood.net/) 

3. Charaeter Edueation Partnership (http://www.eharaeter.org/) 

4. Collaborative for Aeademie, Soeial, and Emotional Learning 
(http://www.easel.org/sel_resourees/linksindex.php) 

5. SAMHSA’s National Registry of Effeetive Programs (NREP) 

6. Offiee of Safe and Drug Free Sehool Programs Exemplary and Model Programs 
(http :// WWW .ed.gov/ admins/lead/ safety/ exemplaryO 1 / index .html) 

7. The Center for Information and Researeh on Civie Learning and Engagement 
(http://modelprograms. samhsa.gov/template. efm?page=nrepbutton) 

8. Miehigan Model Partnership for Charaeter Edueation 
(http ://www.eme . emieh.edu/ eharaetered/) 

9. National Serviee Learning Partnership (http://www.serviee-learningpartnership.org/) 

10. National Center for Learning and Citizenship, Edueation Commission of the States 
(http://www.ees.org/html/projeetsPartners/ele/ele_main.htm) 

11. Serviee Learning Researeh and Development Center (http://gse.berkeley.edu/researeh/sle/) 

12. Center for the 4*^ and 5*^ R’s (http://www.eortland.edu/e4n5rs/CONTENTS.htm) 

13. (indexes of similar organizations embedded in the above websites, sueh as 
http://www.eortland.edu/e4n5rs/reso_iii.asp) 
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Personal Contacts 

The WWC Character Education Evidence Report Team will solicit studies directly from 
knowledgeable informants in the field of character education. This will include members of 
organizations associated with character education, researchers who publish on character education, 
grantees, evaluators funded for character education programs, and other such persons. 

Another source of contacts will be the developers of programs identified as relevant to the topic. 
The WWC Character Education Evidence Report Team will solicit studies and any additional 
information about the program from the developers. 

A third source of personal contacts will occur after the identification of studies to be reviewed. We 
will contact the authors of these studies to answer specific queries and request additional materials. 
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